Goto

Collaborating Authors

 declarative language


A Declarative Query Language for Scientific Machine Learning

arXiv.org Artificial Intelligence

The popularity of data science as a discipline and its importance in the emerging economy and industrial progress dictate that machine learning be democratized for the masses. This also means that the current practice of workforce training using machine learning tools, which requires low-level statistical and algorithmic details, is a barrier that needs to be addressed. Similar to data management languages such as SQL, machine learning needs to be practiced at a conceptual level to help make it a staple tool for general users. In particular, the technical sophistication demanded by existing machine learning frameworks is prohibitive for many scientists who are not computationally savvy or well versed in machine learning techniques. The learning curve to use the needed machine learning tools is also too high for them to take advantage of these powerful platforms to rapidly advance science. In this paper, we introduce a new declarative machine learning query language, called {\em MQL}, for naive users. We discuss its merit and possible ways of implementing it over a traditional relational database system. We discuss two materials science experiments implemented using MQL on a materials science workflow system called MatFlow.


RLang: A Declarative Language for Describing Partial World Knowledge to Reinforcement Learning Agents

arXiv.org Artificial Intelligence

We introduce RLang, a domain-specific language (DSL) for communicating domain knowledge to an RL agent. Unlike existing RL DSLs that ground to \textit{single} elements of a decision-making formalism (e.g., the reward function or policy), RLang can specify information about every element of a Markov decision process. We define precise syntax and grounding semantics for RLang, and provide a parser that grounds RLang programs to an algorithm-agnostic \textit{partial} world model and policy that can be exploited by an RL agent. We provide a series of example RLang programs demonstrating how different RL methods can exploit the resulting knowledge, encompassing model-free and model-based tabular algorithms, policy gradient and value-based methods, hierarchical approaches, and deep methods.


New Research on Exhaustive Search part2(Machine Learning)

#artificialintelligence

Abstract: Symbolic regression is a powerful system identification technique in industrial scenarios where no prior knowledge on model structure is available. Such scenarios often require specific model properties such as interpretability, robustness, trustworthiness and plausibility, that are not easily achievable using standard approaches like genetic programming for symbolic regression. In this chapter we introduce a deterministic symbolic regression algorithm specifically designed to address these issues. The algorithm uses a context-free grammar to produce models that are parameterized by a non-linear least squares local optimization procedure. A finite enumeration of all possible models is guaranteed by structural restrictions as well as a caching mechanism for detecting semantically equivalent solutions.


Invited Talk: Symbolic Reasoning About Machine Learning Systems (PADL 2020 : 22nd Symposium on Practical Aspects of Declarative Languages) - POPL 2020

#artificialintelligence

I will discuss a line of work in which we compile common machine learning systems into symbolic representations that have the same input-output behavior to facilitate formal reasoning about these systems. We have targeted Bayesian network classifiers, random forests and some types of neural networks, compiling each into tractable Boolean circuits, including Ordered Binary Decision Diagrams (OBDDs). Once the machine learning system is compiled into a tractable Boolean circuit, reasoning can commence using classical AI and computer science techniques. This includes generating explanations for decisions, quantifying robustness and verifying properties such as monotonicity. I will particularly discuss a new theory for unveiling the reasons behind the decisions made by classifiers, which can detect classifier bias sometimes from the reasons behind unbiased decisions.


Can AI Write Its Own Applications? It's Trickier Than You Think - DZone AI

#artificialintelligence

Early last year, a Microsoft research project dubbed DeepCoder announced that it had made progress creating AI that could write its own programs. Such a feat has long captured the imagination of technology optimists and pessimists alike, who might consider software that creates its own software as the next paradigm in technology -- or perhaps the direct route to building the evil Skynet. As with most machine learning or deep learning approaches that make up the bulk of today's AI, DeepCoder was creating code that it based on large numbers of examples of existing code that researchers used to train the system. The result: software that ended up assembling bits of human-created programs, a feat Wired Magazine referred to as "looting other software." And yet, in spite of DeepCoder's PR faux pas, the idea of software smart enough to create its own applications remains an area of active research, as well as an exciting prospect for the digital world at large.


Can AI Write Its Own Applications? It's Trickier Than You Think - DZone AI

#artificialintelligence

Early last year, a Microsoft research project dubbed DeepCoder announced that it had made progress creating AI that could write its own programs. Such a feat has long captured the imagination of technology optimists and pessimists alike, who might consider software that creates its own software as the next paradigm in technology -- or perhaps the direct route to building the evil Skynet. As with most machine learning or deep learning approaches that make up the bulk of today's AI, DeepCoder was creating code that it based on large numbers of examples of existing code that researchers used to train the system. The result: software that ended up assembling bits of human-created programs, a feat Wired Magazine referred to as "looting other software." And yet, in spite of DeepCoder's PR faux pas, the idea of software smart enough to create its own applications remains an area of active research, as well as an exciting prospect for the digital world at large.


Blog Details

#artificialintelligence

Early last year, a Microsoft research project dubbed DeepCoder announced that it had made progress creating AI that could write its own programs. Such a feat has long captured the imagination of technology optimists and pessimists alike, who might consider software that creates its own software as the next paradigm in technology – or perhaps the direct route to building the evil Skynet. As with most machine learning or deep learning approaches that make up the bulk of today's AI, DeepCoder was creating code that it based on large numbers of examples of existing code that researchers used to train the system. The result: software that ended up assembling bits of human-created programs, a feat Wired Magazine referred to as'looting other software.' And yet, in spite of DeepCoder's PR faux pas, the idea of software smart enough to create its own applications remains an area of active research, as well as an exciting prospect for the digital world at large.


Can AI Write its Own Applications? @ExpoDX #AI #ArtificialIntelligence #DigitalTransformation

#artificialintelligence

Early last year, a Microsoft research project dubbed DeepCoder announced that it had made progress creating AI that could write its own programs. Such a feat has long captured the imagination of technology optimists and pessimists alike, who might consider software that creates its own software as the next paradigm in technology – or perhaps the direct route to building the evil Skynet. As with most machine learning or deep learning approaches that make up the bulk of today's AI, DeepCoder was creating code that it based on large numbers of examples of existing code that researchers used to train the system. The result: software that ended up assembling bits of human-created programs, a feat Wired Magazine referred to as'looting other software.' And yet, in spite of DeepCoder's PR faux pas, the idea of software smart enough to create its own applications remains an area of active research, as well as an exciting prospect for the digital world at large.


Data2Vis: Automatic Generation of Data Visualizations Using Sequence-to-Sequence Recurrent Neural…

@machinelearnbot

We formulate data visualization as a sequence to sequence translation problem. TLDR; We train a model that can take in a dataset as input and generate a plausible visualizations as output. This work is done jointly with a colleague (Cagatay Demiralp) and started from a conversation we had after a paper discussion meeting. We had read some papers where various forms of generative models were used to create a wide range of stuff -- from generating images (GANs), music, source code etc to generating questions and answers about images (VQA) etc. Despite the quirks that can sometimes be associated with generative models (one eyed cats, music that ultimately lacks that natural feel etc), they all demonstrate a promise of value when trained and deployed at scale.


One Deep Learning Virtual Machine to Rule Them All

@machinelearnbot

Typically, the development of GPU kernels is a laborious process. However, if the algorithms can be expressed using combinations of high-level operators then it should be possible to generate the GPU kernel. This is what CCT is designed to do. An offshoot of CCT is the Operator Vectorization Library (OVL). OVL is a python library that does the same a CCT but for TensorFlow framework.